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0.  Introduction. 

The  model  discussed  In  [2]i^  Is  generalized  by  the  Introduction  of  noise. 
The  generalization  Increases  the  domain  of  application  as  well  as  making  the 
associated  problems  statistical  (Bayes)  rather  than  purely  probabilistic  as 
formerly. 

A  process,  the  production  process,  Is  either  producing  a  continuous 
stream  of  goods  or  else  Is  In  a  state  of  repair,  A  cycle  consists  of  all  of 
the  events  from  the  time  that  the  production  process  leaves  the  repair  state 
until  It  has  gone  through  production  and  repair  and  Is  once  again  ready  to 
leave  the  repair  state.  The  variable,  t.  Is  used  to  measure  time  from  the  be¬ 
ginning  of  a  cycle.  It  takes  m  time  units  to  go  through  repair  at  a  cost  of 
K  units  per  unit  of  time.  When  the  production  process  Is  producing  and  Is  In 
state  X,  the  Income  from  production  per  unit  of  time  Is  l(x).  When  the  pro¬ 
duction  process  leaves  the  repair  state.  It  Is  In  the  0  state,  l.e.,  x(0)s0. 

It  Is  assumed  that  x(t)  Is  a  Poisson  stochastic  process  with  parameter  In 

particular,  when  x(t)  changes.  It  Is  a  unit  Increase,  the  number  of  changes  per 
unit  of  time  Is  Poisson  distributed  with  parameter  A^,  and  the  times  between 
changes  have  Independent  exponential  distributions  with  expectation 
a/  Work  supported  In  part  by  the  Office  of  Naval  Research. 

1/  The  present  paper  Is  self  contained  as  far  as  results.  It  Is  necessary 
to  read  [2]  to  obtain  additional  motivation  as  well  as  details  for  some 
of  the  proofs . 
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Observations  are  made  on  a  process  y(t)=x(t)+z(t) ,  where  z(t)  is  a  Poisson 

process  with  parameter  A  .  The  x-  and  z-  processes  are  assumed  Independent. 

z 

Hence  y(t)  Is  a  Poisson  process  with  parameter  Ay=A^+A^.  (it  will  be  useful 
to  define  H=l/Ay=(A^+A^)"^.)  Thus  we  cannot  observe  the  production  process 
directly.  The  noise,  z(t),  contaminates  the  observations.  For  example,  If 
y(t)  Is  an  Instrument  reading  used  to  make  Inferences  about  x(t),  then  z(t) 
can  be  thought  of  as  the  accumulated  calibration  error.  It  Is  assumed  z(0)b0 
and  hence  y(0)=0,  e.g.,  repairs  Include  recallbratlon. 

In  Section  1,.  It  Is  assume'  that  y(t)  Is  observed  continuously.  In 
Section  2,  It  Is  assumed  that  each  observation  of  y(t)  costs  L  units;  ob¬ 
servation  results  are  obtained  Instantly  and  an  observation  must  be  obtained 
exactly  at  the  time  that  repairs  begin.  The  primary  purpose  of  the  analysis 
Is  to  obtain  methods  for  finding  qualitative  properties  of  the  optimal  solutions, 

The  methods  used  are  sufficiently  general  to  allow  minor  variations  In  the 
model  without  requiring  an  entire  redevelopment.  For  Instance,  dropping  the 
restriction  of  looking  at  the  production  process  Immediately  before  beginning 
repairs  would  not  Involve  difficult  changes.  The  full  strength  of  the 
assunq>tlon  that  the  x-  and  z-  processes  are  Poisson  might  not  be  required, 
but  the  weakening  of  this  assumption  certainly  can  not  be  made  as  completely 
as  It  was  done  when  Just  dealing  with  y(t)=x(t)  [2,  Section  3]*  Specific 
choices  of  the  Income  function  l(x),  computation  procedures,  and  numerical 
examples  are  not  discussed.  It  Is  hoped  that  the  general  qualitative 
properties  obtained  for  the  solutions  will  help  sufficiently  In  a  particular 
problem  so  that  detailed  numerical  analysis  will  not  be  necessary. 


1 .  Continuous  Surveillance. 

A  cycle  will  consist  of  T  units  of  production  time  where  T  is  determined 
by  the  rule  used  for  placing  the  production  process  in  the  repair  state. 
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T  will  be  a  random  variable  and  can  depend  on  the  data  obtained  up  to  the 
time  when  production  is  stopped,  i.e.,  T  can  depend  on  y(.)  for  0  S  t  S  T, 
Since  the  cycles  all  begin  In  the  same  state,  the  choice  of  the  rule  should 
be  the  same  for  each  cycle.  If  R  is  a  specific  rule,  let  T(r)  be  the 
associated  random  time.  Then  the  long  run  average  Income  per  unit  of  time. 


I(R),  la 


I(R)  = 


T(R) 

E[  J  i(x(t))dt]-iiiK 

0 _ 

ET(r)  +  m 


The  basic  problems  are  to  Isolate  the  reasonable  rules,  to  evaluate  I(R) 
for  those  rules,  and  to  find  properties  of  the  best  rule  among  the  reasonable 
rules.  When  y(t)=x(t).  It  was  found  that  the  reasonable  rules  were  to  select 
an  Integer  w  and  to  stop  production  as  soon  as  x(t)  exceeded  w,  I.e.,  T(w)  was 
the  smallest  solution  of  x(t)=w+l.  In  this  section,  it  is  shown,  even  when 
y(t)  contains  noise,  that  the  reasonable  rules  involve  the  selection  of  an 
Integer  w  and  T(w)  Is  the  smallest  solution  of  y(t)=w+l.  When  wa-1,  the 
production  process  will  always  be  kept  In  repair.  When  w=«>,  the  production 
process  is  never  repaired.  Thus  for  decision  purposes  the  history  of  how 
y( . )  arrived  at  w+1  Is  not  relevant.  In  other  words,  in  making  inferences 
about  x(.)  at  time  t  from  observing  y(.)  up  to  time  t,  y(t)  Is  a  sufficient 
statistic.  The  basic  result  Is  contained  In; 

Theorem 

P(x(T)=kly(.),  0  S  t  S  T)  =  P(x(T)=kly(T)). 

Let  p=A  /(a  +A  )  =  A  /A  =HA  ,  and  y(T)=n.  Then  the  following  is  well 
X  z  X  X 

known . 

Theorem  2. 

P(x(T)=kjy(T)=n)  =  . 
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(Using  Theorems  1  and  2,  one  can  say  that  x(.)  for  t  >  T  is  a  Poisson 
process  with  a  random  starting  point  selected  from  a  binomial  distribution.) 
Proof  of  Theorem  1^. 

The  proof  Is  by  Induction  on  the  value  of  y(T) .  If  y(T)  =  0,  then 
x(T)  =  0  and  the  result  is  trivial.  Now  let  t^^  be  the  smallest  solution  of 
y(T)  =  1  for  1=0, 1,2,...  .  Clearly, 

P(x(T)=k|y(.),  0  S  t  S  T  and  y(T)=i)  =  P(x(tj^)=kly( . ) ,  0  S  t  S  t^^)  . 

Now  proceed  with  the  induction  argument,  using  the  following  decomposition, 
P(x(ti+l)=kly( .),  0  s  t  s  t^^j) 

=  P(x(t^)=k  and  x(t^^^)-x(t^)=0ly(  . ) ,  0  S  t  S  t^,  and 
+  I’(x(t^)=k-1  and  x(t^^j^)-x(t^)=lly( . ) ,  0  S  t  S  t^,  and  . 

Now  use  the  Independence  of  the  Increments  of  the  x-  and  y-  processes,  l.e., 
the  future  does  not  effect  the  past  and  the  past  does  not  effect  the  changes 
which  will  occur  In  the  future.  Then 
**(x(ti^l)=kly(.),  0  S  t  g 

=  P(x(t^)=k|y(.),  0  S  t  S  t^)P(x(t^_^^)-x(t^)=Olt^  and 
+  P(x(t^)=k-l|y(.),  0  S  t  S  t^)P(x(t^^j^)-x(t^)=l|t^  and  . 

Using  the  Induction  hypothesis,  one  obtains 

(1.1)  P(x(t^^^)=kly(  .),  0  S  t  S  t^^j^) 

=  P(x(t^)=kly(t^)=i)p(x(t^^j^)-x(t^)=Olt^  and  t^^^) 

+  P(x(t^)=k-lly(t^)=l)p(x(j;^^j^)-x(t^)=llt^  and 
At  this  point  we  require 

(1.2)  l-P(x(t^^j^)-x(t^)=0|t^  and  t^^^^)  =  P(x(t^^j^)-x(t^)=l 1 1^  and  t^^j^)  =  p. 
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Now  using  (1.2)  and  Theorem  2  in  (l.l),  one  finds 
P(x(T)=kly( .).  0  S  t  S  T  and  y(T)=i+l) 


i-k+1  ,i+l^  k/,  ^i+l-k 

P  =  (  )P  (1-p) 


This  completes  the  proof  of  the  theorem,  since  the  desired  probability  depends 
on  y(.),  OS  t  S  T,  only  through  the  value  of  y(T), 

The  following  theorem  will  not  be  used  here  but  is  easily  proved  at 
this  point. 

Theorem 

Let  y(t)=x(t)+z(t)  where  x(t)  and  z(t)  are  independent  Weiner 
processes  with  variance  parameters  and  .  Then 

P(x(T)=xly(.),  0  S  t  S  T)dx  =  P(x(T)=x|y(T))dx 

and  the  conditional  distribution  of  x(T)  given  y(T)  is  normal  with  mean 
y(T)C  /(C  +C  )  and  variance  TC  C  /(C  +C  ) . 

X  X  Z  X  Z  X  z 

Proof . 

Ih  Theorem  1,  let  A  =AC  and  A  =AC  ,  then  the  variables 
XX  z  z 

[x(t)-tAC  ]A  [z(t)-tAC  ]a"^,  and  [y(t)-tA(C  +C  )  ]a”^  will  have  the 
properties  of  the  variables  in  the  present  theorem  as  A  tends  to  infinity. 

Now  consider  the  evaluation  of  l(w) .  It  is  clear  that 

ET(w)  =  (w+l)H 

and  thus  the  denominator  of  l(w)  is  of  the  form  (w+l)H+m,  The  evaluation  of 
the  numerator  will  require  more  detail: 

T(w)  T(w) 

E[ J  l(x(t))dt]  =  E[E( J  l(x(t))dt)|x(T(w))  and  T(w)]. 

0  0 

Given  the  value  of  x(T(w)),  the  points  of  increase  of  x(.)  in  the  interval 
0  S  t  S  T(w)  will  be  uniformly  distributed,  so  that 
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x(T(w-l)) 

E[  /  l(x(t))dt]  =  E  T{w)  £  i(j)/(l+x(T(w-l))) 

i  J=0 

=  E  T(w)  E  (”)p®(l-p)''‘®[  £  i(j)/(l+a)] 

a=0  j=0 

=  (w+l)H  E  (")p®(l-p)"‘®[  E  l(j)/(l+a)] 
a=0  “  J=0 

-  H  L  (":rj)p‘(i-p)"-‘[  L  i(j)i 

a=0  j=0 

Finally 

(1.3)  I(w)  =  [H  E  (”;|;})p*(l-p)''"®(  E  i(j))-iBK]/[(w+l)H+m]. 

a=0  j=0 

The  remaining  problem  la  Co  find  Che  besC  choice  of  v.  The  followlvig  Cheorems 
give  bounds  for  l(w). 

Theorem  4. 

w 

l(w)  i  maximum  [A  ^  E  i(j)-inK]/[A  ^  (w+l)+m]. 
w  j=0 

Proof. 


The  quanClCy  being  maximized  on  the  right  hand  side  In  the  statement 
of  the  theorem  is  l(w)  with  p=l.  This  expression  was  obtained  in  [2]  when 
there  was  no  noise,  (it  should  be  easier  to  evaluate  than  l(w) ,  In  that  It 
does  not  Involve  a  double  summation.)  The  proof  is  made  by  noting:  If  It 
were  possible  to  observe  directly  the  process  x(t),  then  at  no  cost  an 
artificial  process  z(t)  could  be  added  to  it.  Hence,  any  strategy  which  is 
available  when  obseirving  x(t)+z(t)  is  also  available  when  observing  x(t). 

Theorem  5 • 

maximum  l(w)  ^  maximum  l(t) 
w  t 
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where  l(t)  Is  the  Income  corresponding  to  the  rule  of  having  each  cycle  of 
length  exactly  t+m.  Furthermore 

-At  00  (tA 

l(t)  =  [Ae^  E  (  E  l(j))-mK]/[t+m]. 

^  a=l  j=0 

Proof. 

Since  the  best  fixed  time  strategy  can  not  be  as  good  as  the  best 
strategy,  one  immediately  obtains  the  main  result  of  the  theorem.  The  ex¬ 
pression  for  l(t)  is  a  routine  computation.  When  i(x)  is  a  low  degree 
polynomial,  it  is  not  difficult  to  evaluate  l(t). 

Below,  the  symbols  on  the  left  are  defined  by  the  symbols  on  the  right: 

P(a.w)  =  (”)p^l-p)''-‘ 


c(a)  =  E  i(j)/(a+l) 
j=0 


w 

b(w)  =  E  p(a,w)c(a) 
asQ 

Notice 


l(w)  =  [(w+l)Hb(w)-mK]/[(w+l)H+m]. 

Lemna 

p(a,w)  considered  as  a  density  function  in  a  with  parameter  w  is 
P^lya  type  00  and  in  particular 


A  A 

E  p(a,w)  >  E  p(a,w+l). 
a=0  a=0 


pA 


p(a,w)  considered  as  a  density  function  in  a  with  parameter  p  is 
ya  type  oo  and  in  particular 


A 

E  p(a,w) 
a=0 

is  for  each  A  and  w  a  decreasing  function  of  p. 
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I 


Proof . 


See  [1]  for  definitions  and  methods. 

The  following  Lemna  will  help  In  the  analysis  of  l(w). 

Lenina  2. 

If  l(x)  Is  non  Increasing  then  c(a)  and  b(w)  are  non  Increasing. 
Also,  b(w),  for  fixed  w.  Is  a  non  Increasing  function  of  p. 

Proof. 

That  c(a)  Is  non  Increasing  Is  Immediate,  The  proof  for  b(w)  Is 
based  on  the  following 

<D  a-1 

b(w)  =  E  (c{a-l)-c(a))[  E  p(j>w)]. 
a=l  j=0 

In  this  expression  for  b(w)  the  coefficients  of  the  Inner  summation, 
c(a-l)-c(a),  are  non  negative  and  the  value  of  the  Inner  summation  Is  a 
non  Increasing  function  of  w.  Hence  b(w)  Is  a  non  Increasing  function  of  w. 
On  the  other  hand  the  inner  summation  Is  a  non  Increasing  function  of  p,  so 
that  b(w)  Is  a  non  increasing  function  of  p. 

2 .  Costly  Surveillance . 

A  strategy  In  this  case  consists  of  the  following:  Select  a  time  T(o) 

at  which  the  first  Inspection  will  be  made;  select  a  W^(T(0))  such  that  If 
y(T(0))  is  not  in  W^(T(o)),  begin  repairs,  but  if  y(T(o))  is  In  W^(T(0)) 
then;  select  a  T(T(0) ,y(T(o)))  and  make  the  next  observation  at  time 
T(0)  +  T(T(0),y(T(0))):  select  a  W^(T(o) ,y(T(o) ) ,T(T(o) ,y(T(o) ) ) )  such 

that  If  the  observation  at  this  time  is  not  in  W^,  begin  repairs,  but  If  the 

observation  Is  In  then;  select  T(t(o) ,y(T(0) ) ) . 

The  class  of  possible  strategies  is  large.  The  following  theorem, 
however,  simplifies  the  matter. 
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Th«orem 

Let  t  t  .....t  be  an  increasing  sequence  of  numbers  such  that  for 

. . .  one  has  that  t^  depends  on  t^  and  y(t^)  for  j  <  i  (t_^  and  y(t_^) 

can  be  arbitrary  fixed  numbers).  Then 

P(x(t  )=kly(t  )  and  t^,  for  i=l,...,r)  =  P(x(t^)=kly(tj.)) . 


Remark . 

In  interpreting  this  theorem  in  terms  of  the  above  discussion,  let 

to=T(o).  t^=T(0)  +  T(T(0),y(T(0))) .  The  implication  of  the  theorem  is 

that  in  predicting  the  future  history  of  x(t)  given  this  kind  of  past  history 
for  y(t),  the  only  relevant  information  is  y(t^),  t-e-.  the  last  observation. 
This  implies  that  the  class  of  reasonable  strategies  consists  of  the  selection 
of  a  set  W  and  a  sequence  of  numbers  T(0)  ,  T(1) , . . . »T(k) .  Then,  if  an 
observation  is  not  in  W,  begin  repairs,  and  if  an  observation  equals  k  which 
is  in  W,  wait  T(k)  units  of  time  before  making  the  next  observation. 

Proof  of  Theorem  6. 

The  Inctement  In  »(.)  tn  the  Interval  (tj.j.t^)  le  htnomlelly 
dletrihuted  with  p.re«ter.  ,  end  y(tj)-y(t^.j) .  Also  the  Increment,  ere 
Independently  dletrihuted.  Hence  the  eum  of  the  Increment,  le  blnomlally 
dletrihuted  -Ith  peremeter.  p  end  y(t^).  Which  1.  the  deelred  c««lu.lon 
and  yields  the  following  theorems. 

Theorem  7. 

y(tr)  y(ty)-'^ 

p(x(t^)=k|y(t^)  and  t^,  for  i=l,...,r)  =  (  )p  (T-p) 


Theorem  8. 

Let  y(t)=x(t)+z(t)  where  x(t)  and  z(t 
processes  with  variance  parameters  and  C^. 

P(x(t^)=xly(t^)  and  t^,  for  i=l,...,r 


)  are  independent  Weiner 
Then 

)dx  =  P(x(t^)=xly(t^))dx 
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and  the  conditional  distribution  of  x(t^)  given  y(t^)  is  normal  with  mean 
y(tr)Cjj/(Cx+C^)  and  variance  . 

[In  the  statements  of  Theorems  7  3,  it  is  implicitly  assumed  that 

the  conditions  on  t^  of  Theorem  6  are  satisfied.] 

Assume  there  exists  a  best  strategy  and  let  be  the  maximum  income  per 
unit  of  time.  Our  objective  is  to  bound  and  to  find  qualitative  properties 
of  the  best  strategy,  (it  will  be  left  as  a  conjecture  that  there  is  a  best 

strategy.  In  fact,  it  will  be  assumed  that  there  is  a  unique  best  strategy.) 

2/ 

If  an  observation  has  just  been  obtained—  and  found  to  be  y,  then  let 
F*(y)  be  the  expected  income  remaining  in  the  cycle  if  the  best  strategy  is 
followed.  Let  T*(y)  be  the  expected  time  to  complete  the  cycle  if  the  best 
strategy  is  followed.  Our  interest  will  be  centered  on  the  function 
^(y)=y*(y)“T*I*.  An  interpretation  of  F(y)  is  the  maximum  expected  income 
remaining  in  a  cycle  when  the  observation  y  is  obtained  and  at  each  instant 
of  time  the  rate  of  income  is  I*  less  than  in  the  original  problem.  It  can 
be  shown  that  F(0)=‘0.  Also  the  following  functional  equation  can  be  obtained: 

-m(K+I*)  -  L,  y 

(2.1)  F(y)  =  maximum  -j  T(y) 

W.  T(y)  J  (i(x(t))-l*)dtly(0)-y]..;.  L 

0 

»  -T(y)A  - 

+  E  e  ^  (T(y)A  )J(j:)’^(y+j),  y^W 
j=0  ^ 

The  unknowns  in  this  equation  are  F(y),  W,  T(y),  and  I*.  Clearly 

(2.2)  F(y)  i  -m(K+I*)  -  L. 

Since  F(0)=0,  one  obtains 

(2.3)  I*  S 

2/  The  cost,  L,  to  obtain  the  observation  is  to  be  paid  immediately  after 
the  observation  is  made. 
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Also,  if  l(x)  Is  non  Incrsasing  then 

(2.4)  F(y)  <  0,  y=1.2 . 

To  find  an  upper  bound  on  !')<',  consider  the  inqpoasible  strategy  of  stopping 
the  production  process  at  the  moment  y(t)  leaves  the  optimal  W  and  to  do  this 
with  one  look.  Since  y(t)  increases  by  unity,  this  would  correspond  to 
stopping  as  soon  as  y(t)  >  w  for  the  best  choice  of  w.  Then,  the  upper 
bound  on  would  be 

(2.5)  maxiimim  [(w+l)Hb(w)-mK.-L]/[ (w+l)H+m] . 

0  ^  w 

A  weaker  upper  bound  could  be  obtained  by  using  Theorem  4.  A  lower  bound  on 
I-)^  could  be  obtained  by  using  the  non  optimal  rule  of  having  each  cycle  exactly 
of  length  T+m  and  choose  the  best  value  of  T.  Thus,  a  lower  bound  for 
would  be 

T 

(2.6)  maximum  [E[  /  i(x(t)dt]  -  L  >niK]/[T4-m] . 

0  S  T 

In  any  case,  I'**'  is  an  increasing  function  of  p. 

If  y  £  W  then  it  is  desirable  to  continue  production  at  least  until 
y(t)=y+l.  If  we  could  progress  from  y  to  y+1  without  paying  for  observations, 
there  would  be  a  savings .  Hence 

T 

(2.7)  F(y)  £  F(y+1)  +  E[( J  l(x(t))dt) ly(0)-y]  -  HI* 

0 

where  T  is  the  first  time  point  of  Increase  In  y(.)  after  leaving  y,  i.e., 

T  is  the  smallest  solution  of  y(t)=y+l  given  y(0)=y.  The  expected  value  of 
the  integral  in  (2.7)  can  be  expressed  in  the  following  form 

H  I  (^)p^(l-p)^'^i(j). 
j=0  ^ 
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The  expected  value  of  the  Integral  In  (2.1)  can  be  expresaed  in  the 


following  forms: 

T(y) 

(2.8)  E[ J  (l(x(t))-l*)dtly(0)-y] 
0 


E  (;;)p^i-p)' 

I'-O  • 


-A  T(y)  , 

*  (A^T(y))*  (a'l)-^ 


{  L  T(y)(l(a+j).I*)/(a'+l) 
^  J=0 


} 


■{  L  (l(a+j)-I* 

t  j=0 

Now  assume  l(x)  la  a  non  Increasing  function  of  x.  Then 

d(a)  =  L  e  ^  (A  t)*'(a”.)"^  {  S  t(l(a+j).I*)/(a'+l) 
a'=0  ^  j=0 

Is  a  non  Increasing  function  In  a.  Hence,  for  a  fixed  value  of  T(y),  the 
expression  (2.8)  Is  a  non  Increasing  function.  This  result  liq>lles: 

Theorem  9- 

If  l(x)  Is  non  Increasing,  then  F(y)  Is  non  Increasing  and  W  Is 
either  empty  or  of  the  form  (0,1,..., w). 

Proof. 

If  W  Is  empty,  l.e.,  the  process  Is  always  In  repair,  there  Is  nothing 
to  prove.  If  F(y)  Is  non  Increasing,  It  Is  clear  that  W  should  be  of  the  de¬ 
sired  form.  Hence  the  crucial  result  Is  to  show  that  F(y)  Is  non  Increasing. 
The  proof  Is  by  contradiction.  Assume  there  exists  a  y'  such  that  y'  and 
y'+l  are  In  W  and  F(y')  <  F(y'+l).  Then  consider  the  following  non  optimal 
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strategy:  If  during  a  cycle  y'ls  observed  behave  as  l£y'+l  had  been  observed, 

e 

l.e.,  for  the  rest  of  the  cycle  if  y^  Is  observed  use  T(y*-fl)  and  stop  pro¬ 
duction  as  soon  as  a  y^  is  observed  such  that  yM’+l  is  in  W.  Now  use  the 
aonotonicity  property  of  (2.6)  and  the  one  to  one  probability  mapping  of 
paths  through  y'andy/-)-!.  This  yields  the  desired  contradiction. 

Theorem  10. 

If  l(x)  is  non  increasing  and  y  is  in  W,  Chen 


E(i(x)|y)  =  I  (y)pJ(l-p)y"Ji(j)  a  I*. 
j=0 


If  I*  is  replaced  by  a  lower  bound,  say  1*,  then  the  largest  value  of  y 
satisfying  B(i(x)|y)  is  an  upper  bound  for  w,  defined  in  Theorem  9< 

Theorem  11. 

If  i(x)  is  non  increasing  then  T(y)  is  non  increasing. 

Proof . 

The  proof  is  similar  to  that  of  Proposition  3>1^  of  [2].  Define 
g(y,t)  as  the  expected  income  (reduced  by  I-*^  per  unit  of  tiise)  remaining  in 
.Che  cycle  when  Che  best  strategy  is  followed,  the  process  is  now  at  y,  and 
t  units  of  time  remain  until  the  next  observation.  (  g(y,t)  is  defined  only 
for  y  in  W.)  The  main  part  of  the  proof  is  Co  show  that  the  functions  g(y,t) 
have  a  unique  maximum  in  t  for  each  y.  First,  it  will  be  shown  that  g(v,c) 
has  a  unique  maxisum.  After  some  computations ,  one  can  obtain: 


g(w,t)  =  -L  -  m(K,+I*)  +  L  p(a',t)C(a') 

a'-O 

where 

p(a',t)  =  e^  /(a')  I  . 

C(0)  =  F(w)+m(K+I*) 
a'-l 

C(a')  =  L  B(j),  for  a'=l,2,...  , 
J-0 
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&nd 

B(J)  =  2  (^)p‘(l-p)”"‘[i(a+j)-I*]. 

a=0 

Now  p(a',t)  Is  of  p/lya  type  3  so  that  If  the  sequence  C(a')  has  at  most 

one  maxlnum,  then  g(w,t)  has  at  most  one  maximum  [1].  Because  l(x)  is  non 
increasing,  it  is  clear  that  B(j)  is  non  increasing.  Then  for  a'  ii  1, 

C(a')  is  increasing,  decreasing,  or  first  increasing  and  then  decreasing. 

Next,  we  must  show 

C(0)  <  C(l) 

or 

(2.9)  F(w)<A‘^  L  (pp*(l.p)"“®[i(a)-I*]-m(K+l*). 

a=0 

The  quantity  on  the  right  hand  side  corresponds  to  using  the  super  optimal 
strategy  of  stopping  production  as  soon  as  a  transition  in  the  x(.)  process 
occurs  after  y(t)=w  and  this  is  done  with  no  inspection  cost.  Hence 
inequality  (2.9).  Hence  the  entire  C(j)  sequence  has  at  most  one  sieximum  and 
g(w,t)  has  at  most  one  maximum,  (if  there  is  no  maximum,  either  there  is  no 
production  or  there  is  no  repair.) 

The  remainder  of  the  proof  easily  follows  form 

(2.10)  g'(y,t)  =  e  ^  [F(y+l)-F(y)  +2  (^)p*(l-p)^"“(i(a)-I*)  +  f  a  ^  g(y+l,z)d*] 

a=0 

where  y  <  w  and  g'  is  the  derivative  with  respect  to  t. 

Theorem  10  can  be  improved,  to  yield: 

T(y) 

(2.11)  E[ J  (i(x(t))-l*)dtly(0)=y]  i  0. 

0 

It  can  be  shown  that  T(y)  is  less  than  the  unique  root  of  this  Inequality  and 
if  I*  is  replaced  by  a  lower  bound,  then  the  root  will  be  increased.  The 


► 
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bounds  from  (2.11)  will  be  decreasing  In  y.  (  l(x)  Is  assumed  non  Increasing.) 
A  lower  bound  can  be  found  corresponding  Co  Proposition  (3>l6)  of  [2]. 
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Appendix;  Questions 

1.  When  does  l(w),  see  equation  (l.3)>  have  a  unique  maximizing  value  when 

considered  as  a  function  of  w? 

2.  When  does  the  expression  In  Theorem  4  have  a  unique  maximizing  value  when 

considered  as  a  function  of  w7 

3.  When  are  Che  best  choices  of  w  In  equation  (I.3)  <ind  In  Theorem  9  decreasing 

functions  of  p  for  fixed  H? 

4.  When  Is  T(y)  a  decreasing  function  of  p? 
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